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Abstract. This paper studies the problem for an afhne hypersurface system to reach a 
polytopic target set starting from inside a polytope in the state space. We present an 
exhaustive solution which begins with a characterization of states which can reach the 
target by open-loop control and concludes with a systematic procedure to synthesize a 
feedback control. Our emphasis is on methods of subdivision, triangulation, and covers 
which explicitly account for the capabilities of the control system. In contrast with previous 
literature, the partition methods are guaranteed to yield a correct feedback synthesis, 
assuming the problem is solvable by open-loop control. 



1. Introduction 

Problems of reachability for dynamical systems have been extensively studied in the control 
literature for a long time. These problems have attracted renewed interest due to the emer- 
gence of new paradigms for switched and piecewise linear systems. This paper studies the 
problem for an afhne system to reach a polytopic target set starting from inside a polytope 
in the state space. Promising new ideas have appeared in the last hve years in this area, 
and these ideas have stimulated deeper study of the many open questions that remain. An 
important gap in the literature is an exhaustive solution which covers the following sub- 
problems: explicit conditions for and an analysis of all states which can reach the target 
by open-loop control; a method to approximate the open-loop reachable states when there 
are control constraints; a systematic method to form a subdivision of the polytope into a 
set of reachable states and a set of failure states; and finally a systematic procedure to syn- 
thesize a feedback control. While parts of this research program have been studied under 
various assumptions, no overall end-to-end solution has been presented. The reason is that 
the problem is generally extremely difficult and for certain steps, almost nothing is known 
about systematic procedures. In order to tackle this problem, rather than scoping back the 
problem specification as has typically been done before, we retain the complete problem 
statement but work with a specific class of systems: affine hypersurface systems which are 
n-dimensional affine systems with (n — 1) inputs. This class is our focus of study for the 
following reasons: (1) The problem of developing a systematic methodology to synthesize 
controllers for reachability specifications is essentially open, and beginning with a specific 
class of models provides much needed insight which can be built upon for generalization. 
The outcome of our study is that we are able to provide a complete solution for affine hyper- 
surface systems. In so doing we introduce new techniques for triangulation and subdivision 
which can be adapted to the general problem. (2) Hypersurface systems include as a spe- 
cial case second-order mechanical systems, which are an important benchmark class for new 
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control design methods. More generally, second-order systems have attracted extensive the- 
oretical study due to their strong geometric properties. (See [7] for a recent example). (3) 
Hypersurface systems have particularly simple reachable sets. By studying these systems, 
we separate the challenges inherent in dealing with complex reachable sets from the other 
challenges presented by dealing with control synthesis on a state space which is a polytope. 
The contributions of the paper are therefore squarely in the area of triangulations, subdi- 
visions, and covers. What this suggests for future investigations is very important: if the 
designer is willing to relax the requirement to find the largest set of states in the polytope 
that can reach the target and instead he works with approximations which have reasonable 
properties, and where importantly, reasonable properties are determined not based on tra- 
ditional interpretations of hard and easy reachability computations, but based on how easily 
one can find triangulations and subdivisions to solve the synthesis problem, then one has a 
hope to develop systematic procedures which are provably successful. 

We will now outline the sub-problems which are addressed in this paper. Some of these 
sub-problems simply involve packaging known results in an appropriate way. Other results 
are novel and have never been studied before. The latter are especially in the area of 
forming triangulations and subdvisions adapted to a given control synthesis problem. The 
first sub-problem we address is: given a polytopic state space V and a polytopic target set 
T in the boundary of V, characterize explicitly the set of states in V which can reach the 
target by open-loop control. This result relies on well-known properties of the reachable 
sets of hypersurface systems. While it is a stepping stone to later results, its importance 
stems from the fact that knowing explicitly if a particular reachability problem is solvable 
by open-loop control gives a concrete metric against which to test our results: our synthesis 
methods should apply to any problem for which is a solution by open-loop control exists. 
The next sub-problem is to develop an algorithm which "cuts off" the failure states in 
a systematic way, so that the remaining set V contains the original target set T and is 
a polytope for which the open-loop reachability problem is solvable. It is shown that a 
systematic method to cut off the failure regions can be done with only two techniques based 
on the system structure. This algorithm can be easily adapted to include bounds on the 
control input. Once it is known that for a polytopic subset of the state space all points can 
reach the target by open-loop control, one then addresses questions of control synthesis, 
and this is the heart of the paper. 

We develop a set of triangulation and subdivision procedures which are organized hierarchi- 
cally. By a hierarchical organization we mean the following. At level one of the hierarchy is 
a subdivision method which solves the given reachability problem on the polytope. When 
that subdivision method is applied, it leads to sub-reachability problems on sub-polytopes 
which are solved by subdivision methods at level two of the hierarchy, and so forth. What is 
important is that there are a finite number of levels and one can prove that the refinement 
by new subdivisions terminates. This contrasts with the view that one simply refines by 
arbitrary subdivisions selected by a computer program - a method that has no guarantee 
to terminate even of the problem is solvable by open-loop control. 

One of the challenges in developing these subdivision methods is to determine the simplest 
set of methods which can completely solve the problem. We present such a set, though it 
is by no means unique. We propose a five-level hierarchy: 

(1) For linear and affine systems, problems of reachability are closely tied to existence 
of equilibria. Therefore, the first level is a subdivision along the hyperplane O of the 
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possible equilibria of the system; namely those points in the state space for which 
there exists a control input to make the vector field exactly zero. 

(2) The second level of the hierarchy is a subdivision of a polytope which has two 
possible target sets: a neighboring polytope and a target facet. The subdivision is 
in fact a cover to be discussed further below, and is with respect to the boundary 
of the two reachability sets. 

(3) The third level entails a subdivision with respect to T the target set. In particular, 
it applies to the case when T is not a facet of V (motivation for this is discussed in 
Section [1.2p . Two techniques are presented: one is a subdivision and the other is a 
cover. 

(4) The fourth subdivision is a triangulation within a polytope whose interior does not 
intersect O and it has a single target facet. The triangulation is determined using 
information about the dynamics on that polytope. 

(5) The fifth subdivision is a triangulation within a simplex whose interior does not 
intersect O and it has a single target facet. 

In the remainder of the introduction, we review the relevant literature on control synthesis 
for reachability problems on simplices and polytopes. In Section 11.21 we give the context 
of the problem and from this arises the motivation and characteristics of our solution. 
Section 11.31 presents notation and the organization of the remainder of the paper. 

1.1. Historical Overview and Related Literature. While control problems of reaching 
target sets in the state space have been studied since the 1960's, our formulation and ap- 
proach arise from more recent investigations on affine and piecewise affine systems defined 
on simplices and polytopes. The first problem to be studied of this type was by Luc Habets 
and Jan van Schuppen [11] in which they formulated the so-called control-to-facet problem. 
Further results were given in [12J. Given an affine system, the problem is to synthesize an 
affine control to reach an exit facet of a simplex in finite time. Necessary conditions called 
invariance conditions in the form of linear inequalities defined at the vertices of the simplex 
were presented which restrict the closed-loop vector field to point inside appropriately de- 
fined tangent cones of the simplex. A sufficient condition was also presented to ensure that 
all closed-loop trajectories exit the simplex. Based on the invariance conditions, an elegant 
synthesis method was proposed to obtain an affine control u = Kx + g to solve the problem. 
In |13[ [20] the control-to-facet problem using affine controls for affine systems defined on 
simplices was improved (to allow that trajectories need not exit the simplex at the first time 
they reach the exit facet), and more concise necessary and sufficient conditions were ob- 
tained. The new conditions consist of the original invariance conditions of [1 1|. 112] combined 
with a flow condition which guarantees that all trajectories exit the simplex, or equivalently 
that the closed-loop system has no equilibria in the simplex. The control-to-facet problem 
for a polytope as well as hybrid systems was also studied in [13]. The proposed method 
is to partition the state space into simplices, to form a discrete graph capturing the adja- 
cency of simplices, and then to solve, via a dynamic programming algorithm, a sequence of 
control-to- facet problems. When the algorithm terminates successfully it is guaranteed to 
provide a piecewise affine controller solving the reachability problem. 

The problem of reachability with state constraints is related to the viability /capturability 
problem in viability theory, especially characterizing viability kernels with a target and 
viable-capture basins for differential inclusions. The concept of viability kernel with a target 
by a Lipschitz set- valued map has been introduce and studied in [15] : This is the subset of 
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Figure 1. The problem of temporal logic controller synthesis. 



initial states in a constrained set from which at least one solution remains in the constrained 
set (i.e., is viable) forever or reaches (i.e., captures) a target in finite time before possibly 
violating the constraints. The set of initial states satisfying only the latter condition is called 
the viable-capture basin of the target. Some abstract properties and characterizations of 
viability kernels and viable-capture basins of a target are further studied and provided in 

A number of methods to construct piecewise affine feedbacks on polytopes for various control 
specifications such as stabilization, optimal control, and set invariance have already been 
developed. The recent text [5] presents an overview of methods for set invariance, which 
can be viewed as the dual to the problem of reachability. Piecewise affine systems have 
been the subject of a large number of papers. A small sampling of recent papers includes 
HI El El [19] . Several interesting applications of piecewise affine modeling have recently 
been explored. See for example [8]. 

1.2. Context and Motivation. This paper considers the problem of reaching a target Xf 

with state constraint in a set X, denoted as X — > Xf. The motivation for this fundamental 
problem arises from a family of related reachability problems. Two sample reachability 
problems are as follows. 

(1) Reach - Avoid problem. Starting at any initial state in a bounded set Q, reach a 
target set Qt while avoiding an unsafe region Q u . The problem can be formulated 

as X — ► Qt, where X = Q — Q u . A typical example of the problem is motion 
planning of multiple vehicles. 

(2) Temporal Logic Controller Synthesis. Consider, for example, three areas of interest 
denoted by Qo, Qi, Q2 such that Qi, Q2 C Qo (see Figured]) and the temporal logic 
specification DQo A 0(Qi A (Q1UQ2)), which is interpreted in natural language as: 
"Stay always in Qo an d visit Qi, then stay in Qi until it visits Q2 eventually." The 

problem can be thought of as two reachability problems Qo — Q2 ^— ? 2 Qi and 

Qi ^ Qi- 

This family of reachability problems motivates the particular features of the problem studied 
in the paper, in which each Qi is a polytope and each target is a polytope in the boundary 
of Qi. The dynamics in each Qi may or may not be the same (although we do not study 
the hybrid problem here). Sub-reachability problems are sequenced in order to achieve a 
global specification. It may happen that a certain reachability problem fails for a particular 
polytope and one must restrict the polytope by cutting off failure regions. Such restrictions 
would propagate to neighboring polytopes and reduce their feasible target sets. It would 
be extremely tedious to leave these interventions to the designer, and rather, an automated 
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algorithm should resolve these failures. This justifies our choice to solve the reachability 
problem when the target is not a facet of a polytope. 

1.3. Notation and Organization. We use the following notation. Let rank(-B) and Im(B) 

o 

denote the rank and the image of a matrix B. Let A be a set. A , conv(^4), vert (.A), and 
aff(„4) denote the interior of A, the convex hull of A, the vertices of A, and the smallest 
affine space containing A, respectively. Let B be another set. A \ B expresses the set 
difference. Moreover, dist(x,*4) expresses the distance from a point x to the set A. Finally, 
we let \x [C] be the volume of an n-dimensional set C. If C is of dimension less than n then 
/i [C] = 0. 

The paper is organized as follows. In Section [2] we formulate the problems to be solved. 
In Section [3] we characterize the set of states which can reach the target T starting in a 
polytope V. Then in Sections 0] and [5] we show how to synthesize piecewise affine controls 
on simplices and polytopes, respectively, assuming the problem is solvable by open loop 
control. In Section [6] we show how to subdivide a polytope with respect to a target set 
which is not a facet, and in Section [7] we show how to subdivide a polytope with respect to 
the set of possible equilibria of the system. 



2. Problem Formulation 

Let V be an n-dimensional polytope in IR n and consider an affine control system on V, 

E: x = Ax + a + Bu=: f(x,u), x£V, (2.1) 

where A £ ~M. nxn , B £ M. nxm , a£E™ and the control u G W 71 lives in the space of piecewise 
continuous functions. Assuming that rank(i?) = n — 1, we call £ an affine hypersurface 
system. Given a piecewise continuous function u : 1 1— > u(t) and an initial state xq G V, let 
(j)f(xo) denote the unique solution of X starting from xo- 

In order to precisely formulate our problem, we begin by defining two concepts. The first 
is that of reaching a target with constraint in a set, which is the analogue to the notion of 
capturability in viability theory PJ. Second, we define fi-invariant sets. In viability theory 
such a set is called locally invariant relative to £1 [2]. 

Definition 2.1. Let and £lf be closed sets satisfying n £lf ^ 0. 

(a) A point x G Q, can reach Uf with constraint in Q,, denoted by x — > Qf, if there 
exists a piecewise continuous control u : t \— > u(t) and T > satisfying (^{x) £ $7/ 
and (ftt(x) G for all t G [0, T]. Otherwise, we say x cannot reach Qf with constraint 

in Q, denoted by x 7^— »• $7/. 

(b) A set Q,' C O can reach Qt with constraint in £1, denoted by Q' — > Qf, if x — > £lf 
for every x G fl' . 

The maximal reachable set of£lf in will be denoted by Reach(f2, ^/). 

Definition 2.2. For a closed set O, a set A C f2 is called ^-invariant if for all xo G ^4 
and for all piecewise continuous functions u : 1 1— ► u(i), every trajectory 0"(xo) in on an 
interval [0, T] with T < 00 or [0, 00) is in A on the same time interval. 
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The definition means that the trajectories cannot leave A before leaving f2. The following are 
elementary properties of O-invariant sets which can be obtained directly from the definition. 

Lemma 2.1. The union and intersection of two 0,-invariant sets are also ^.-invariant sets. 
The union of all points xq G A for which each trajectory segment <P^(xq) is in A for the 
same time it is in £1 is the maximal ^.-invariant set in A. 

The following result relates the set of states that can reach Q,f with constraint in Q to 
J7-invariant sets. The proof is in the Appendix. 

Proposition 2.2. Q — > Qf if and only if no Q-invariant set is in 

Now we introduce the assumptions on S. Let B denote the (n — l)-dimensional subspace 
spanned by the column vectors of B (namely, B = Im(i?), the image of B). Define 

O := {x G R n : Ax + a G B}. 

When the pair (A, B) is controllable it can be shown that O is an affine space (see also 
|17j). Notice that f(x, u) on O can vanish for an appropriate choice of u, so O is the set of 
all possible equilibrium points of the system. We make the following standing assumptions 
until Section [TJ 

Assumption 2.1. 

(Al) rank(B) = n - 1. 

(A2) The pair (A, B) is controllable. 

(A3) V n O = 0. 

(A4) The target set J- is an (n — l)-dimensional polytope on the boundary of V . 

Problem 2.1. We are given £ such that Assumption 12.11 holds . 

■p 

(a) Find necessary and sufficient conditions such that V — > T. 

(b) Find Reach('P, J-), the maximal reachable set of T in V. 

(c) Find a triangulation T and a piecewise affine feedback such that Reach (V, J-) — ► T . 

3. Reachability on Polytopes 

In this section, we focus on the open-loop reachability problem and the first aim is to find 

V 

necessary and sufficient conditions for V — ► T . The strategy is to isolate all "P-invariant 
sets in V\ T . Note that proofs of lemmas for this part can either be found in the Appendix 
or we have omitted them in case they were direct logic arguments not adding insight for 
the reader. 

Denote by B x the hyperplane parallel to B and going through a point x. Let f3 be the unit 
normal vector to B satisfying (5 T (Ax + a) < for all x G V. Such (5 always exists by our 

assumption that V H O = 0. Let v ~ be a point in argmin{/3 T x : x G J 7 } and v + a point in 
argmax{/3 T x : x G J-}. Define the closed half-spaces in V 

H~ := {x G V | fx < p T v-}, 
n + := {x G V | (fx > p T v + } . 
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Figure 2. Illustration for Theorem 13.51 

Also, for any z G R n , define H~{z) := {x £ V \ (3 T x < (3 T z] and H + (z) := {x e V \ f3 T x > 
/3 T z}. Finally, we introduce the set 

V + := argmax{/3 T x | x & V} . 

o 

Because J> PI O = 0, we know that for each initial condition in V, all trajectories will 
only flow in one direction relative to hyperplane B. In particular, the /3-component of any 
trajectory, (3 ■ </>"(xo), is always non-increasing by the convention that (3 ■ (Ax + a) < 0, 
Vx 6 V . Now the points v~ and u + mark the points in T with minimum and maximum f3 
components. It is clear that if there is any xq € V with a (3 component smaller than v~ , 
then no 4>^(xq) can reach J 7 . The following lemma confirms this intuition by showing that 

o 

1i~ and H ~ are "P-invariant sets. 

o 

Lemma 3.1. Let z be a point in V . The sets TL~(z) and TL ~(z) are V-invariant. 

V 

The previous discussion suggests that a first necessary condition for V — > T is that 
TL~ \J r C V \ T is empty. This is not quite right. There can be points x £ B v - n O 
which can still reach T . This is the content of the next lemma. 

Lemma 3.2. Let y, z be distinct points in V and let I be the line segment joining them. If 
z,y G O and y G B z , then z y. 

In light of this, we define the following set: 

g_ _ f B v - n o if B v - n o n T ^ 

1 otherwise. 

Lemma 13.21 says that points in B~ can reach J 7 , so these points should not be included 

v 

in a candidate failure set. Thus we arrive at our first necessary condition for V — > T\ 
Hr \ [T U B~) = 0. Figure [2] shows a shaded region corresponding to failure of this 
condition. 

Another failure leading to a second necessary condition is as follows. If xq £ O, then it is on 
the boundary of V and the instantaneous motion from this point is only along B. If B does 
not intersect the tangent cone of V at xo, then the only way to avoid a trajectory leaving 
V immediately is to place an equilibrium point at xq. The following lemma captures this 
situation by showing how "P-invariant sets arise along O. See the right side of Figure [2j 
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Lemma 3.3. Let z be a point inV . If B z nV C O, then B z nV andV\B z are V '-invariant. 

A more subtle argument is needed to show that our proposed conditions are also sufficient 
to solve the reachability problem. Sufficiency relies are two properties: the system is con- 
trollable, so it has sufficient maneuverability on O, and the following lemma which provides 
the required maneuverability off of O. 

Lemma 3.4. Let y ^ z E V and let I be the line segment joining them. If z,y O and 
y £H (z), then z — > y. 

Theorem 3.5. V T if and only if (a) H~ \ {J 7 U B~) = %, and (b) V + £ On H + . 

o o 

Proof of Theorem \3.5[ (=^) First, suppose (a) does not hold. If Tt ~ ^ 0, then H 
is a P-invariant set by Lemma 13.11 and it is in V \ T ', so the conclusion follows from 

o 

Proposition 12.21 Instead, if H _ = 0, then 7i~ = B v - n V. Since (a) does not hold, there is 
z E (B v - nV)\(J 7 UB-). For this point (3 T (Az + a) < 0, so for any u, f3 T (Az + a + Bu) < 0. 

This implies any trajectory starting at z immediately leaves V . Hence, z 

Second, suppose (b) does not hold, i.e. V + C On Ti + - Let z E V + and notice that 
P+ = B z n V. Thus, B z n V C O. By Lemma S3] it follows that V + is P-invariant. In 

addition, from the assumption that V + CH + , V + C V \ T. The conclusion follows from 
Proposition 12. 2[ 

■p 

(<^^) Suppose conditions (a) and (b) hold. For a point x E it is trivial that x — ► T . 

o 

Let x E V\(!FUO). By assumption (a) x ^ 7i~ or equivalently v~ £ri ~(x). Consequently, 

o 

there is a point y E Af(v~) n T satisfying y E7Y ~{x), where J\(v~) is a sufficiently small 
neighborhood of v~ . If J 7 is not in O, such a point y can be chosen not in O. Then these 

two points x and y satisfy the assumption in Lemma 13.41 so x y, where I is the line 

V 

segment joining x and y. Clearly, I is in V as V is convex. Hence, x — ► J- . Otherwise, 
suppose T C O. It is easy to show that because (A, B) is controllable, B is not parallel to 
O. It means we can select a control u so that f(y,u) points outside of V. Thus, there is a 

o 

sufficiently small e > such that 4>^{y) 7 t E (— e, 0) is in p . Note that 4>t{y) is continuous 

o o 

and y £TC ~{x), so there is a point z E (j)f(y),t E (— e, 0) satisfying z £7{ ~(x) and therefore 
z EP • Thus, (3 T (Az + a) < by assumption. Applying Lemma [3.41 for the two points 

x and z leads to x z, where / is the line segment in V joining x and z. Considering 

V V 
z — > y E T, we then have x — > T . 

Finally, let x E (V D O) \ T . Clearly, x is on the boundary of V . If B x n V $L O, then select 
a point y E (B x HV)\0 and let u be chosen such that f(x, u) = Ax + a + Bu = y — x, which 
is possible because both (Ax + a) and (y — x) are in lm(B). Note that this vector field 
f(x, u) points inside the polytope V . This implies the trajectory instantaneously enters the 
interior of V, which is not in O any more. Then by the previous argument, it can be driven 
to reach T through a line. Otherwise, if B x n V C O, then the whole set B x n V is on 
the boundary of V, and moreover it comprises either V + or argmin{/3 T x : x E J-}. From 

o 

condition (b), V + C 7i~(v + ) and this implies V + n J- ^ 0. From condition (a), TC ~ = so 
argmin{/3 T 3; : x E J 7 } C TC + (v~), which implies argmin{,9 T x : x E J 7 } H ^ 0. For both 
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cases, we get B x n T 7^ 0. Now we select a point y € B x C\ J 7 . Then these two points satisfy 
the assumption in Lemma 13.21 Thus, it follows that x — — > y, where I is the line segment 
joining from x to y, and so x — ► T. □ 

-p 

Theorem 13.51 gives necessary and sufficient conditions for the reachability problem V — ► J 7 . 

This result, in turn, can be tied to failure sets, apropos Proposition 12.2^ which are the V- 

invariant sets in V \ T: 

a~ = ur) (3.i) 

-4 + = IT " r C ° n " + 
I v) otherwise. 

Corollary 3.6. Let A = A~llA + . Then Reach{V,T) = V\A. Moreover, Reach(J> , F) Reac ^ 
J 7 and A 

We have identified Reach (V, J 7 ), the maximal reachable set of J- in V . This set, in general, 
is not closed. This leads to difficulties with unbounded control effort and unbounded time to 
reach T . Consequently, once failure sets have been identified, it is desirable to remove them 
via a procedure that both well-approximates the maximal reachable set and also yields 
a closed n-dimensional polytope that can reach J-. The approach is to "cut off" failure 
sets from V by one of two procedures. One procedure is for removing the failure A~ by 
cutting along a hyperplane which is parallel to a slightly shifted version of B. The second 
procedure is for removing A + by cutting exactly along a hyperplane parallel to B. These 
cuts are chosen arbitrarily close to the failure sets and so that the remaining polytope has 
no failure sets. It should be noted that the following procedure can be easily adapted to 
convert explicit bounds on the controls to an appropriate e. 

Algorithm 1. (Let e > be sufficiently small.) 

(1) If ^ 0, select affmely independent points Zi,...,Zk in T<T\B V - and also in the rela- 

o o 

tive boundary of the facet containing J 7 , and then select points Zk+x, ■ ■ ■ , z n in "p fl "H 

+ (v~) such that Q := affjzi, . . . , z n \ is of dimension n— 1 and max dist(x, B v -) = e. 

xevng 

Then divide V along Q. 

(2) If A + 7^ 0, select a point z € V such that max dist(x, B z ) = e. Then divide V along 

xeA+ 

B z . 

Let A e _ , A e+ , and Reach e ('P, J 7 ) be the collection of sets after the application of the division 
rules in Algorithm [fl where A e _ contains A~ , A t+ contains A + ', and Reach e ('P, J 7 ) is the 
remainder. Clearly, these three sets (if not empty) are n-dimensional polytopes and J 7 C 
Reach^T 7 , J 7 ) C Reach("P, J 7 ). Then we have the following corollary which follows directly 
from Algorithm [1] and Theorem 13.51 

Corollary 3.7. 

(a) ReacUV.T)^^ T. 

(b) lim e _ « \Reach{V,T) \ Reach e (V , J 7 )] = 0. 

o -p 

(c) For any x £V , if x — > J 7 there exists an e > such that x G Reach € (V , J 7 ) . 
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Example 3.1. Consider the example in Figure which illustrates the first step of Algo- 
rithm [TJ Suppose that there a failure set to reach T along the red segment. If one were to 
cut only along points in T C\B V - which corresponds to the blue plane, then the failure set 
would not be cut off. Instead, if points in the relative boundary of the facet containing T 
can be used, then this failure set can be removed. 

Example 3.2. A simple example is presented to illustrate the possible failure sets and how 
Algorithm Q] cuts them off. Consider the system 

xi = x 2 , 
x 2 = u. 

It can be easily verified that O = {(x\,X2) ■ x 2 = 0}, the x\ axis, and that B is just the 
X2 axis. Suppose that the polytope V and the target set T are as shown in Figure [H The 
hyperplane O touches the polytope but has empty intersection with its interior. We get 
A~ = 7i~ \T which is the patterned region in Figure^ and A + is just a point. Reach(7 3 , T) 
is the set V' not including the boundary of A~ and A + . This set is not closed. Moreover, 
if an initial state xq £ V' approaches the boundary of A~, the control input u(xq) tends 
to infinity in order to reach T with constraint in V . Also, if xq € V approaches the 
boundary of A + , the time to reach T tends to infinity. Applying Algorithm [H a good 
closed e-approximation Reach e (7 3 , of V' is given on the right of Figure HI 
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Consider an n-dimensional simplex S with vertices vo,vi, . . . ,v n and facets J^o, . . . , T n (the 
facet is indexed by the vertex not contained). Let I := {1, . . . ,n}. 

Problem 4.1. Consider system (12. ip defined on S. Find an affine feedback control u = Fx+g 
such that for every xq G S there exist T > and e > satisfying: 

(i) <ft(x Q ) G S for all t G [0,T]; 

(ii) </%(xo) g -F ; 

(iii) <^(x ) £ 5 for all t€(T,T + e). 

Condition (iii) is interpreted to mean that the closed-loop dynamics on <S are extended to 
a neighborhood of S. 

Definition 4.1. The invariance conditions for <S require that there exist Uq,... ,u n G M. m 
such that: 

hj ■ (Avi + a + Bm) < , i G {(),...,»}, (4.1) 

Theorem 4.1. [131 [20] Given the system (12. ip and an affine feedback u(x) = Kx + g, 
where K G M mxn J g G and no = n(t>o), ... ,u n = u(v n ), the closed-loop system satisfies 

(a) T/ie invariance conditions (]4.ip ZioW. 

(b) There is no equilibrium in S. 

Theorem 14.11 cannot be used directly for our present work because it enforces that affine 
feedbacks be used. Unfortunately, this class is not large enough if solvability of RCP by 
open-loop control is the starting point. The next result shows that for hypersurface systems 
on simplices, one sufficiently rich feedback class is piecewise affine feedbacks. The proof is 
in the Appendix. 

Theorem 4.2. [15J If S — > J-q then there exists a piecewise affine state feedback u = 
FfjX + g a , a G {1,2} that also achieves S — > J-q. 

5. Control Synthesis on Polytopes 

We now begin our investigation of state feedback synthesis on polytopes. We want to show 
v 

that if V — ► T using open-loop control then there exists a piecewise affine feedback solving 
the reachability problem. The idea is to triangulate the polytope, transform the reachability 
problem within a polytope into a set of reachability problems for simplices, and then devise 
appropriate piecewise affine controllers on each simplex using Proposition ^. 2l of the previous 
section. The triangulation must be performed properly otherwise the procedure may fail. 
First we present a lemma that aids in finding a proper triangulation. 

Lemma 5.1. IfV — ► T , then there exists a vertex ofV in V + such that either v* £ O 
or v* G T . 

Proof. Suppose by contradiction that for any vertex v G V + we have w£0 and v ^ J-. Note 
that v £ J- for all vertices v G V + implies, by convexity, T J+ C7t + . Moreover, since v G O 
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for all v £ V , it follows from the convexity of O that V + C O. Hence, by Theorem 13. 5\ 
V 

this contradicts V — > T ' . □ 

We review some concepts on triangulation [10]. Suppose V is a finite set of points such 
that conv(V) is n-dimensional. A subdivision of V is a finite collection P = {"Pi, . . . ,V m } 
of n-dimensional polytopes such that the vertices of each Vi are drawn from V; conv(V) is 
the union of Pi, ... , V m \ and Vi n Vj (i ^ j) is a common (possibly empty) face of V% and 
Vj. A triangulation of V is a subdivision in which each Vi is a simplex. In the following we 
assume that J 7 is a facet of V. 

Basic Triangulation of V: 

(1) Select t>* as in Lemma I5TT1 

(2) Triangulate each facet J-j of V. Denote {Sjr. : i = 1, . . . , kj} the triangulation for 

(3) Let § = {Si, . . . ,S q } := {conv(u*,«Sjr.) : Tj is any facet of V not containing v*}. 

Lemma 5.2. The collection § is a triangulation of vert(V) U vert{ J 7 ) such that every simplex 
in S contains as a vertex. 



Proof. By construction, it is clear that every simplex Si € S contains as a vertex, the 
vertices of Si are drawn from vert('P) U vert(J-), and Si n «Sj (i ^ j) is a common (possibly 
empty) face of Si and Sj. Next, we show that V is the union of <Si, . . . ,S q . Let j; be a 
point in the union of «Si, . . . ,S q . Then it must be in a simplex Si. Thus, by convexity of 
V, x £ V. On the other hand, let x be a point in V. Draw a line through and x. It 
intersects at a point y with a facet (say J-j) of V that does not contain v*. It means there 
exists a simplex 5^-. containing y. So X € conv(u*, S^.), one of the simplices in §. The 
conclusion follows. □ 



Now suppose we have a triangulation S = {Si, . . . ,S g } as above, and denote Sq := T . 
We say Si and Sj are adjacent (denoted by Si ~ Sj) if ^ := «Sj PI 5, is a facet. A 

sequence (<Sj fc , . . . ,«Sj ) is called a pa£/i to reach Si if <Sj. ~ and «Sj. — ^> for each 
1 < i < fe> The length of such a path is k. We propose a greedy algorithm that orders 
simplices according to minimum (5 component of exit vertices first. More precisely, at every 
iteration a pair (Si,Sj) is selected that minimizes the /3-component of any vertex on the 
exit facet Tij. If there is more than one pair achieving the minimum, select a pair which 
has the maximum number of exit vertices achieving the minimum. In the algorithm below 
IZj and 7Z U denote the finished and unfinished set of simplices, respectively, and let 

w' € argmin|/3 T j; : x G {S^ D Si : (Sk,Si) € 1Z U X Hf satisfying S^ ~ • 

Greedy algorithm for path generation in S: 

(1) Initialization: IZf := {Sq}, TZ u := {<Si, . . . ,S q }; 

(2) While (TZu ^ 0) , choose (Si ,Sj) £ TZ U xTZf such that Si ~ Sj , it achieves min (3 T x = 

P T w', and Tij contains the maximum number of vertices in B w >. Then move Si from 
TZ U to TZf. 
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Once the greedy algorithm has generated paths, the synthesis of a piecewise affine control 
is straightforward. See also [13] . 

Piecewise affine synthesis: 

(1) Let {...,(..., Si,Sj, . . . , So), . . . } be a collection of paths to reach <S ; 

s 

(2) Find u l {x) := F ai r x \x + g ai (x)i * = 1> • • • >9j that solves — ^ J 7 ^, where Tij is the 
common facet of Sj and the next simplex in the path; 

(3) For all x G Si G §, let u(z) = u l (x). If x G V belongs to more than one simplex, set 
u(x) = u J (x) where j is the index of a simplex that has the shortest path to reach 
S . 

Theorem 5.3. Suppose that J 7 is a facet ofV . There exists a piecewise affine state feedback 

v v 
that achieves V — ► T if and only if V — ► T using open-loop control. 

The idea of the proof is to show that the path generation algorithm does not terminate 
until 1Z U = by showing that for the next selected pair {Si,Sj) G TZ U xTZf, the reachability 

problem Si — Sj can be solved. This is done by applying Theorem 13.51 and verifying 
conditions (a) and (b) for the selected pair (Si,Sj) G 1Z U x IZf. The main effect of our 
selection of triangulation based on vertex v* is that condition (b) holds trivially for any 
such pair. The fact that condition (a) can be made to hold is the main feature of the greedy 
strategy with respect to (3. This strategy guarantees that the vertex vq G 5, not contained 
in the exit facet has a strictly larger /3-component, and this means that failure set A~ = 
for Si. The proof now easily follows from these observations. 

Proof. (=>) Obvious. If the path generation algorithm terminates with 1Z U = 

then by straightforward dynamic programming arguments there exists a piecewise affine 

feedback control that achieves V — > T . It is therefore sufficient to show that if 1Z U ^ 0, 

there exists a pair (Si,Sj) E 1Z U x TZf such that Si D Sj =: Tij is a facet and Si Sj. 

Consider any pair (Si,Sj) € 1Z U X-TZf. We must verify conditions (a) and (b) of Theorem [33] 

to show Si — ^ Tij. Consider condition (b). We have two observations about u*. First, from 
Lemma [5^2] v* G Si, Vi, and therefore v* G Tij. Second, i>* £ V + implies G 5^". Applying 

these two facts, condition (b) for Si Sj says that Sf (£. O n {x G Si : f3 T x > (3 T v*}, and 
this is obviously true. 

So far we have shown that for any pair (Si,Sj) G 1Z U x TZf as above, condition (b) of 

Theorem 13.51 holds for the problem <Sj — ^ Tij . Now we will show that for the selected pair 
(Si,Sj), condition (a) holds. Let t>o be the vertex of Si not in Tij. Let w G Tj nB w i. There 
are three cases. 

(1) Suppose f3 T w < f3 T vo- Then condition (a) holds. 

(2) Suppose P T w > f3 T vo- Also, we know [3 T v~ < (3 T vo < f3 T w from the assumption 

v _ 
V — ► T . By convexity, for every point y on the line segment joining v and Vo, 

P T y < (3 T w. However, v~ G Sq G IZf and vq G Si G 1Z U , which means the line 

segment contains a point y on the boundary of S{i G 1Z U and Sj> G IZf. This 

contradicts the choice of the pair (Si,Sj) that achieves min w . 
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Reach e ('P, J 7 ) 




Figure 5. A triangulation of Reach^T 7 , J 7 ) and a path to reach J 7 . 



(3) Suppose (3 T w = P t vq. Let {v\, . . . ,Vk} be the set of vertices of T%j that lie in B w i. 
If B w i DV C O then condition (a) holds and we are done. If not, it follows from the 

assumption V T that either B w t n V C T or [3 T w' > (3 T v~ . For both cases we 
claim that Q := convjfo, v%, . . . , V).} belongs to some Sk G TZf. For the former case, 
it is obvious since Q C B w i n V C So G TZf. For the latter case, suppose not. Say a 
point x £ Q does not belong to some Sk G 7?-/. Then since the union of sets in TZf is 
a closed set, there exists a point y G p near a; satisfying /3 T y < (3 T w' , and y also does 
not belong to some 5^ G 7£/. This contradicts the choice of the pair (Si,Sj) that 
achieves min (3 T x = f3 T w'. Therefore Q belongs to some Sk G TZf which implies it 



belongs to some facet T\ 



Tij with fyy 



fij/ n Sji, where <Sj/ G TZ U , Sj> G TZf, 



and ^i',/ has one more vertex, namely vq, in B w r. This contradicts the choice of J 7 ^. 

□ 

Example 5.1. Consider again Example 13.21 After applying Algorithm [T] to cut the failure 

sets off, we know from Corollary 13.71 that Reach e (7-', J 7 ) — ^— > ' J 7 using open-loop con- 

trol. We want to find a piecewise afiine state feedback that achieves Reach^T 3 , J 7 ) — —> ' 
J 7 . Denote the vertices of Reached, J 7 ) by V\,...,v§ in Figure [5j It can be easily ob- 
tained that vi is the only vertex of Reach^T 3 , J 7 ) satisfying the property of Lemma 15.11 so 
= vi. Also, v* G" JF. By the proposed triangulation method, we obtain a triangulation 
S = {Si, 52,^3} as shown in Figure [5j By applying Theorem 13.51 to each simplex, it can 

be easily checked that £3 — ^ S2, S2 Si, and Si — v -+ .F. Thus, we can find a control to 
solve the reachability problem on each simplex (based on Proposition 14. 2p and then we can 



construct a piecewise afiine control which achieves Reach (E ('P, J 7 ) 



Reach e (P,.F) 



T. 



6. Triangulation with respect to J 7 

In this section we study how the previous results can be extended to solve the control 
synthesis problem if J 7 is not given as a facet of V. If the designer has flexibility in modifying 
the given state constraints, then one perform a slight modification (by pulling out J 7 ) so 
that J 7 is a facet of a larger polytope V' ■ However, this approach has two caveats: (1) 



TRIANGULATION AND CONTROL 



15 




V2 V 3 



Figure 6. T is not a facet of V but v* ^ T. 

The problem V' T 1 may not be solvable even if V ■—* J- is; (2) If V is part of a 

larger subdivision of the state space, then possibly other polytopes in the subdivision must 

be modified. A more desirable procedure is to use a triangulation method that refines 

the given subdivision of the state space by splitting V so that T becomes a facet of one 

of the polytopes in the refined subdivision. This approach also has pitfalls, because if 

v 

one does not refine the subdivision properly, failure sets may emerge even if V — > J- by 
open-loop control. In this section we show one method (among several) to obtain a proper 
triangulation. 

Let T denote the facet of V containing T . First we consider a simple case when of 
Lemma [5T21 can be selected so that T . See Figure [H 

Triangulation of V with respect to J 7 : 

(a) Select v* as in Lemma I5TT1 and so that v* T ' . 

(b) Make a triangulation of vert(^) U vert(^-") such that the interior of each resulting 
simplex is either entirely in T or not in T . For the remaining facets J-j of V, make 
a triangulation of vert (.7-}). Denote {Sj?. ■ i = 1, ■ ■ ■ ,kj} the triangulation for J-j. 

(c) Let § = {S\, . . . ,S q } := {conv(w*, ) : Tj is any facet of V not containing v*}. 

The first thing we notice is that nothing about the proof of Lemma [5 .21 is specific to T being 
a facet, so the lemma still holds for the new triangulation. Also the proof of Theorem 15.31 
is unchanged since the essential property of v* (namely Lemma l5.2p is still true. Therefore, 
we have the following direct extension of Theorem 15.31 

Corollary 6.1. Suppose that T is not a facet of V and there exists v* as in Lemma \5.1\ 

V 

such that T ■ There exists a piecewise affine state feedback that achieves V — ► T if 
V 

and only if V — * T using open-loop control. 

When there does not exist T, the problem is more complex because Lemma 15.21 
breaks down. Nevertheless, we would like to build upon our previous triangulation and 
control methods by appropriately subdividing V . A natural idea would be to form V\ := 
conv(^ r , v | v £ V \ F), a polytope for which J 7 is a facet. There are two problems to be 

addressed. First, can V\ have failure sets for the problem V\ — ► T even if v — -> n 
Theorem 13.51 tell us that H~ \ (J 7 (1 B~) = and we observe that this condition is identical 

for any polytope with the same exit facet T . Therefore, condition (a) holds for V\ — -> T . 
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V 5 




Figure 7. T = coilv{vi,V2,vs,vq} C T and v * = ^3 G T. 



Instead, it is condition (b) which is problematic because generally P^ 7^ P + and equilibria 

, -p 1 
can appear on P^~ when we try to solve P\ — > T ' . A more careful approach is needed, and 

inspiration is provided by the proof of Theorem l5.3t for any n-dimensional polytope P C P 

with exit facet if P + Pi T 7^ 0, then condition (b) automatically holds. See Figure [7] for 

an example. Thus, we have the following. 

Proposition 6.2. Suppose there exists a vertex of P such that v* G J~P\P + . Let V CP 
be an n-dimensional polytope such that J 7 is a facet of P. Then P T implies P T . 

Proof. Consider condition (b) of Theorem 13.51 for P — ► T. We have to show that P + (£ 
O n {x G P I (i T x > (3 T v + }. But £fnP+ implies P + = {x G P | (3 T x = (3 T v + }, so 
condition (b) is obviously true. 

For condition (a), Theorem 13.51 tells us that Tl~ \ (B~ U J 7 ) = and since H~ = Hr and 
B~ = B~, condition (a) obviously holds for P — > T . □ 

Proposition 16.21 gives some indication of how the polytope P\ which has T as a facet could 
be constructed. Now we face the second problem. The set P\P\ is of course not a polytope. 
How shall it be subdivided and what reachability problems need to be assigned to avoid new 
failure sets from appearing? The problem is difficult due to the generality of the description 
of T . However, the following proposition gives some indication of how other polytopes can 
be constructed which do not have T as their exit facet. 

Proposition 6.3. Suppose there exists u#, a vertex of T, such that G J r nP + . Let 
P C P be an n-dimensional polytope and let T be an (n — 1)- dimensional polytope which is 
a facet of P. Suppose there exist v~ G TO argmin{/? T x | x G P} and v + G F C\ P + . Then 

P T implies P -—* T . 

Proof. By the assumption v + G T D P + and by the same argument as in Proposition 16.21 

condition (b) for P — > T obviously holds. Consider condition (a) for P — > T . It says 
that {x G V I (3 T x < (3 T v-} \ [T U B~) = 0. Equivalently, {x G V \ f3 T x < /3 T v"} = and 
B v - PI P C O U T. Because v~ G T H argmin{/3 T x | x G P}, this means {x G P \ [3 T x < 
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P T v~} = and because B v - n P C O U T, one obtains B v - flfcOUf. Thus condition 
(a) for V — > T holds. So the conclusion follows. □ 

We would like to apply Propositions 16.21 and 16.31 to solve the synthesis problem when T is 
not a facet of P and there exists a vertex of T satisfying v* G T n P + . We introduce an 
important new construct for synthesis of piecewise affine controllers. Rather than using a 
subdivision of V we begin the design with a cover of V, which later will be refined to a 
subdivision for control synthesis. A cover of V is a finite collection P = {Pi, ■ ■ ■ ,P m } of 
n-dimensional polytopes such that the vertices of each Vi are drawn from V and conv(V) is 
the union of Pi, . . . ,V m . Informally, a cover is a subdivision except that the sub-polytopes 
can intersect on their interiors. 

Cover of P with respect to T: 

(1) Select v* a vertex of T such that v* G T n P + . 

(2) Construct any hyperplane that goes through points V- and «*, and partitions P 
into two n-dimensional sub-polytopes Vi and V3 . 

(3) Define Vi = conv(J r , V 2 n V 3 )- 

(4) Define the cover P := {Pi, V 2 , V3}. 

By using this cover, we obtain the following result. 

Theorem 6.4. Suppose that T is not a facet ofV and there exists v*, a vertex of J 7 , such 

. -p 
that v* G F n V . There exists a piecewise affine state feedback that achieves V — ► T if 
v 

and only ifV — * T using open-loop control. 

Proof. Pi is an n-dimensional polytope in P for which T is a facet. Also, v * G T D P + , 
so by Proposition 16.21 Pi — > T. Next, let ^23 = Vi fl and notice that v 23 = v and 
^23 = v *- So by Proposition 16.31 ^2 — ^ -^"23 and V3 ^23- 

Theorem 15.31 gives a piecewise affine control u(x) = F ai ^x + g ai ( x ), x G Pi, that achieves 

Pi -A jc. and it gives = i^^x + g a2 ( x ),x G P 2 and u{x) = F a ^ x) x + ^(i),^ G P3, 

that achieve P 2 — > T23 and P 3 — > T23, respectively. Since T23 C P3, it means that the 
controllers can drive all the states not in Pi to Pi. Thus, the following controller 

{Fax {x)X + 9ax {x) X G Pi 
F a 2 (x)X + 9a 2 {x) xeP 2 \Pl 
F<r 3 {x)X + g a:i (x) x G P3 \ Pi 

achieves P J- . □ 



Finally, we are left with the case when T is not a facet of P , all vertices of P satisfying 
Lemma 15.11 are in T but none of them is in T , and moreover there are no vertices of T in 
P + . See Figure O Fortunately, this case can be easily handled by our previous results, by 
observing that J- and P + are strongly separated so we can split P into a sub-polytope which 
contains T and satisfies Theorem 16.41 and another sub-polytope that does not contain T but 
must be able to reach it. We have the following straightforward extension of Theorem 16.41 
and main result of this section. 
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Theorem 6.5. Suppose that T is not a facet of V . There exists a piecewise affine state 
feedback that achieves V -— > T if and only if V — —> T using open-loop control. 

Proof. We only consider the case excluded by Corollary 16.11 and Theorem 16.41 as described 
above. Consider the hyperplane B v + that partitions V into two sub-polytopes V\ and V2, 
such that f C Pi and v + is a vertex of T satisfying v + G T n (see Figure [8] for an 

example). From Theorem 16. 44 we have that V\ — * T and from the assumption V — ► T 

and Theorem 13.51 it can be verified that V 2 B v + D V. □ 



7. TRIANGULATION WITH RESPECT TO O 



So far we have studied reachability problems and control synthesis under the assumption 

o o 

J> n O = 0. In order to solve the general problem when J> n O 7^ we want to partition V 

along O and apply the results of the previous sections. There are two related complications. 

First, it can happen that when we split V along O to form two polytopes, V\ and V2, one 

of the two target sets V% Pi J 7 , even if not empty, may no longer be an (n — l)-dimensional 

v 

polytope. Even if for example V% — ^ ViCiJ- with the target of dimension less than (n — 1), 
the control synthesis methods of the previous section do not apply. Second, the same lower- 
dimensional reachability problem can arise even if we have not already partitioned along 

V 

O. Therefore, we assume in the following that when we say V — > there does not exist 
a full-dimensional set of states in V that must reach a lower-dimensional (less than n — 1) 

subset in T in order to achieve V T. 

Now we would like to propose a partition method which splits V along O into two polytopes 
V\ and V 2 - Each subpolytope V% will then have two possible target sets. One target is the 
original facet J 7 H V%. A second target is O PI V. This second target captures the idea that 
some trajectories must cross over from one side of O to the other before reaching T . This 
means that a new reachability problem must be investigated which involves two targets. 
One could try to make a subdivision according to which target the points in V% can reach. 
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However, this approach will generally require new techniques not already developed in the 
paper. We illustrate with an example. 

Example 7.1. Consider the 2D example as in Fig. [9j Suppose there are two target sets 







1 / 




B 


\ ' \ 
\ V ' \ 

\ 1 \ 
\ ' \ 








\ ' \ 




Figure 9. 



T\ and JF 2 where T% C O. It can be checked that V — > T\ U T^, but neither V — > T\ or 
V — > T2 holds. If we were to apply Algorithm 1 to cut off the failure set for reaching J-\, we 
would obtain the region on the left-side of the (red) dotted line (parallel to B). However, 
the approximate failure set to reach T\ cannot reach J-2, no matter how small is e, without 
crossing into the region that can reach T\. Thus, if one insists on a true subdivision, the 
reachability problem would not be solvable using our feedback methods. On the other hand, 
Reach e ('P, T\) and Reach^T 5 , T2) is a cover for V, where Reach^T 3 , Ti) is the right-side of 
the red line and Reach^T-*, T2) is the left-side of the green line. 

To most efficiently overcome the issue in the above example, we first subdivide V along O 
and then use a cover in each subpolytope according to two possible target sets. 

Cover of V with respect to O: (Let e > be sufficiently small.) 

(a) Divide V along O to obtain V\ and V2- 

(b) If dim("Pj n T) = n — 1, compute Qn := Reach^T^, Vi PI J 7 ), i = 1,2. Otherwise 
Oil = 0. 

(c) If dim(Pj n Qji) = n - 1, compute Q i2 := Reach e (Vi , Vi n Qji), i = 1, 2, j 7^ i. 
Otherwise Qi2 = 0. 

(d) Define the cover P := {Q u , Q 12 , Q21, Q22}. 

o 

Theorem 7.1. Suppose V H 7^ 0. There exists a piecewise affine state feedback that 

v v 
achieves V — > T if and only if V — ► J- using open-loop control. 

The main idea of the result is that when V is partitioned along O, there are only two types 
of points in each sub-polytope: those that reach T while remaining in the sub-polytope, or 
those that cross over to the other polytope to then reach T . The proof requires a technical 
lemma on reachability of two target sets, whose proof is in the Appendix. 

Lemma 7.2. Let T\ and T2 be two (n — 1)- dimensional polytopes on the boundary ofV but 

o *p 

not on a common hyperplane and assume V H O = 0. If V — > T\ U T2, then there exists 
e > sufficiently small such that Reach € (V,Ti) U Reach £ (V, T2) = V. 
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Proof of Theorem \7.1\ (=>) Obvious. (<=) We use the notation V% ==> V% fl J 7 to mean 
open loop reachability with an (n — l)-dimensional target. We consider two cases. For the 

first case, suppose there exists one sub-polytope, say w.l.o.g. Vi, satisfying V\ =>■ V\ fl T. 

If, in addition, Vi => V2 H J 7 , then we are done. Otherwise, find Q21 by the method above. 

Also compute Q22 := Reach e (V2 , V2 H V\). Now we know that if din^T^ Pi J 7 ) < n — 1, then 

■p 

V — > J 7 implies Q22 = by our assumption, and we are done. Instead, if dim^T^ C\T) = 
n — 1 then by Lemma I7T21 Q21 U Q22 = Vi- 

V 

For the second case, suppose no Vi G \P\1V2\ satisfies V% ==> Vi fl T. Without loss 
of generality, suppose dim('Pi fl J 7 ) = n — 1 and Qn 7^ 0. Find Q21, as above. Note 

v 

that Q21 may be empty. Because V — * J 7 , there exists e > sufficiently small so that 
dim('P2 H Q11) = n — 1 and the states in V2 that cannot reach V2f^J 7 must be able to reach 

V2 H Q11. Therefore, we have V2 — ^ (^2 H J) U (P2 H Q11). Compute Q22 by the method 
above. Now we know that if dim(7 7 2 n T) < n - 1, then V 2 ^ (V 2 n J 7 ) U (V 2 n Q u ) 
implies Q22 = T2 by our assumption. Instead, if diu^T^ f\J-) = n — 1 then by Lemma 17.21 
Q21 U Q22 = V2 ■ Repeating the argument for Vi, the result is obtained. □ 

8. Conclusion 

We have presented methods of triangulation, subdivision, and covers for reachability and 
control synthesis for affine hypersurface systems. Some unique features of this work are: (1) 
We begin with an analysis of open-loop reachability, and we do not impose what class of 
controls should be used to implement the reachability specifications. Because of the struc- 
ture of hypersurface systems, we then derive that piecewise affine feedbacks are a sufficiently 
rich class to solve such problems. (2) We place emphasis on techniques of triangulation and 
subdivision, guided by the the principle that these cannot be performed independently of 
control synthesis. In particular, we show how the flow conditions of a system provide critical 
information for triangulation, and this can be used to establish greedy dynamic program- 
ming algorithms which are guaranteed to outperform dynamic programming algorithms 
based on random triangulations of the polytopic state space: our algorithm always finds 
a solution when one exists via open-loop control. (3) We introduce a technique of covers 
for forming partitions of the state space. This useful technique overcomes many technical 
problems with taking subdivisions. Fortunately, it naturally leads to synthesis of piecewise 
affine feedbacks. 

We have concentrated on hypersurface systems because of their simple, well-understood 
reachable sets. To extend our ideas to general systems, a carefully weighed analysis of the 
tradeoff between the conservatism of reach set approximations and complexity of the result- 
ing algorithms must be made. Our work points in the direction of keeping the algorithms 
as simple as possible, by using the simplest possible partition methods which can guar- 
antee successful termination of numerical procedures. Our future work will explore these 
challenging problems. 

Appendix 

8.1. Proof of Proposition 12.21 (=>) Assume that there exists an ^-invariant set, say 
A, in Q \ Qf. For any xq £ A, let u : t 1— > u(t) be any piecewise continuous function. Then 
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V 



c T x = yi Jx = y 2 



Figure 10. An illustration of the proof. 



by Definition 12 . 2 1 every trajectory in Q on an interval is also in A on the same time interval. 



fi' = O \ Q". This also immediately implies that 0," is an fi-invariant set, since otherwise 
there would exist some trajectory 4>f(xo) with xq G £1" that reaches £ls \ 0," = £1'. Also 
0," C Q\Qf. This completes the proof. 

8.2. Lipschitz Continuity of Marginal Functions. Let X and 3^ be two sets, G be a 
set-valued map from y to X and / be a real-valued function defined on X x y. We consider 
the family of maximization problems 



which depend upon the parameter y. The function g is called the marginal function. A 
general discussion on continuity properties of marginal functions can be found in [Vj. Here 
we focus on the case of linear afflne functions and single out a useful consequence of Lipschitz 
continuity. Let 



where a G R n , b G R, c G R n , and V is a full dimensional polytope in R n . (In another 
form, V can be written as V = {x G R n : Ax H e}, where A £ R mxn , e G R m , and ^ 
means less or equal componentwise.) The domain of the marginal function g is given by 
V = {y G R : G(y) + 0}. 

Lemma 8.1. The marginal function g(y) is locally Lipschitz on its domain T>. 

Proof. For any yi,y% G T>, it is clear that G{y\) and G{y2) are lower-dimensional polytopes 
in V . Let v\ , . . . , Vk be the vertices of G{y\). For each i = 1, . . . , k, let a point start moving 
from t>j along the edges of P. It first meets the hyperplane c T x = y% at a point, denoted 
by ^j. Then, Wi must be a vertex of G{y 2 ) (note that and wj may not be distinct). 
The path that the point goes through from V{ to Wi is composed of either a single edge or 
joint edges of V (see Figure [TOl for an illustration in 2D). Firstly, if it is a single edge of V, 
this edge can be algebraically represented by {x G R n : Anx = en and Ai 2 x -< e^}, where 




g{y) : 




/(x, y) = a T x + 6 and G(y) = {x G "P : c T x = y} 
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An G R^ n 1 ^ xn and A i2 G R^ m n+1 ) xn are formed by the columns of A with suitable order. 
Since V{ is on the edge and also on the hyperplane c T x = yi, it follows that 



' Ail ' 


-1 


en 


T 






C 







For the same reason, we have 



Hence, \\v{ — Wi\\ < Li\\yi — 2/2 1 1 , where Li only depends on A and c. Secondly, if it is 
composed of joint edges, without loss of generality, say there are two connected edges since 
it has the same argument for the case with more than two edges. Two edges are connected 
at a point, say v, which lies between the hyperplanes c T x = yi and c T x = y 2 ( see Figure [TUl 
for an example). Let the parallel hyperplane going through the point v be c T x = y' . Thus, 
y' G [2/1,2/2]- By the same argument above, it follows that — < L\\\y' — yi\\ and 
— Wi\\ < Lf 1 1 2/2 — y' || , where Lj and Lf depend on A and c. Let Lj = max(Lj, Lf). Thus, 
we have 

lk-Wi|| < < L}\\y'-yi\\+Lf\\y 2 -y'\\ < Li(\\y' -yi\\ + \\y 2 -y'\\) = Li\\y 2 -yi\\ 

Next, we show that g(yi) — 5(2/2) < L\\yi — y 2 \\, where L is a constant. We know that 
for any y\ G V, there exists a x\ G G(yi) satisfying g(yi) = f{x\,y\). On the other 
hand, the point xi can be written as a convex combination of the vertices of G(yi), i.e., 
xi = ^2 i= i fcAjfj, where Aj > and X^=i fc^i = 1- Now consider the same convex 
combination of points Wi,i = l,...,k, which is given by x 2 = Yli=i k ^i w i- Notice that 
Wi, i = 1, . . . , k are vertices of G(y 2 ) as we showed before, so the point x 2 is in G(y 2 ) and 
therefore g(y 2 ) > f(x 2 ,y 2 ). Then we deduce that 

5(2/1) -5(2/2) < - f(x 2 ,y 2 ) < \\a\\\\xi - x 2 \\ < \\a\\\\ Ei=i,...,fc >*( v i ~ w i)\\ 

< \\ a \\J2i=i,...,k M\ v i ~ w i\\ ^ Nl X)i=i,...,fc^i||yi -ViW - ||a|| max^i^llyi 

Recall that Lj depends only on A and c. So there is an upper bound L only depending on 
A and c such that L > Li for any i. Thus, let L = \\a\\L and we obtain 5(2/1) — 5(52) < 
L\\yi — 2/2 1 [ - Hence, it is locally Lipschitz. □ 

8.3. Proof of Lemma (37H Let G : R -> 2 P be the set-valued map G(y) = {x G "P : 
/3 T x = 2/}. Its domain is T> = {y G R : G(y) 7^ 0}. We define the real-valued function 

g{y) := ra<ut{(3 T {Ax + a) : x G 5 G V. 

By Lemma [87TT the function g{-) is locally Lipschitz. Let (f>t(yo) be the solution of y = g(y) 
with initial state 2/0 • Since (3 T (Ax + a) < for all x G V and n T 7 = G(y*), for some 
y* G £>, we have 5(5*) < 0. Thus, we know 4>t{yo) < y* for all t > if 50 < 2/*- 

Now, consider any initial state xq G 7iJ D V and any piecewise continuous function u : t 1— > 
u(i). Let x(t),t G [0, T] be the trajectory segment defined in with initial condition xq 
and control input u(t). Introduce £(t) = (3 T x(t), t G [0, T]. Then we have 



Notice that x(t) G V and (3 T x(t) = It implies that x(t) G G(£(t)) for t G [0,T]. Hence, 
we know f3 T (Ax(t) + a) < g(£(t)) (or equivalently, < 5(£(t))) from our construction 
of 5(-). By the Comparison Principle (Theorem 1.4.1, p3]) it follows that < </>t(£(0)) 




1 -l r 



2/2 



f (t) = /? T x(i) = P T (Ax(t) +a + Bu(t)) = p T (Ax(t) + a). 
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for t G [0,T]. Also, x G W~ n P implies that f(0) < y*, so <M£(°)) < 2/*- Consequently, 
we obtain £(t) < y*, which in turn implies x(i) G 7iJ PI P for all t G [0,T], meaning that 

o 

Tig n P is P-invariant. Following along the same lines, Tt ~ Pi B is P-invariant. 



8.4. Proof of Lemma 13.21 For any x G I, let Ax + a + 5u = \'(y — z) where A' > 
is any constant. Note that y G B z implies (y — z) G Im(B), and by convexity we have 
[3 T (Ax + a) = 0, which implies (Ax + a) G lm(B). Therefore, the above linear equation has 
a unique solution u x . Then following along the same lines as for Lemma 13.41 it is obtained 

that z -—>■ y. 



8.5. Proof of Lemma 13.31 If r (Ax + a) = for all x G B Z C\V, then from Lemma I3TT1 it 

O rp 

follows that H~P\V and Ti z HP are P-invariant. On the other hand, rewrite (3 (Ax+a) = 
as (— (3) T (Ax + a) = 0. Then (— f5) T (Ax + a) < for all x G B z nV, so again from Lemma [3TT1 

we obtain Hf D V and H + n V are P-invariant. By Lemma E31 n P) n (Hf D V) and 

o o 

are P- invariant. The former set is exactly B z PiV and the latter set 

isP\£ 2 - 



8.6. Proof of Lemma 13.41 Since y G?Y J , one obtains — z) < 0. It implies that 

the stacked matrix [-B (y — z)\ is of full rank. Then there is a unique solution u x and 
X x to the linear equation Ax + a + -B-u x = A x (y — z) for a given point x G /. Moreover, 
from the assumption z, y G" O, we obtain that (5 T (Az + a) < 0, (3 T (Ay + a) < and then 
by convexity we have P T (Ax + a) < 0, Vx G Z. So (5 T (Ax + a + Bu x ) < 0. This together 
with j3 T (y — z) < leads to A x > 0, Vx G I. Applying u x , the resulting closed- loop system 
is x = X x (y — z). Thus, the trajectory remains in I. Moreover, in the compact set /, A^ 
is bounded away from zero. So j3 T \ x (y — z) < 5 for some 5 < 0, which implies that the 
trajectory starting from z reaches y in finite time. 



8.7. Proof of Proposition 14.21 We begin by checking the invariance condition. Let w- 

(w + ) be a vertex in argmin{/3 T t; : v G vert(^"o)} (arg max{/3 T u : v G vert(^o)}) respec- 
tively) . 

First, we consider the case that vi £ O. For this, we discuss two situations depending 
on (5 T Vi > j3 T W- or f3 T Vi = (i T W-. (Note that it is impossible to have f3 T Vi < (3 T W- by 

Theorem 13.5( a) since S — > J-'q.) 



(i) If 1 V{ > 1 W-, then there is a point p G<S such that f5 T Vi > 1 p (or equivalently 



jr. 



P T (P 



< 0). Let 



Avi + a + Bui = X(p 



where A is a scalar to be determined. Writing in a compact form, we have 



[-B (p 



Vi 



A 



Avi + a. 



Note that (p — V{) ^ B, so the matrix [-B (p — m)] is of full rank and therefore the above 
equation has a unique solution Uj and A. Also, notice that j3 T (Avi+a+Bui) = j3 T (Avi+a) < 
and that T (p-v i ) < 0. Thus, we have A > from (|8.ip . From the definition of simplices, 
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it follows that hj • v$ = Cj and hj -p < Cj for any j ^ i, where Cj is a constant. This leads to 
hj ■ (p — Vi) < 0, which further implies that there exists a Ui attained from (|8.ip satisfying 

hj ■ (Avi + a + Bui) = Xhj ■ (p — Vi) < for any j ^ i. (8-2) 

(ii) If (3 T Vi = (3 T w- : then Vi ^ vq since otherwise it contradicts to (Ti w _ PI 5) \ (.Fo U 0) = 

inferred from S — ► ^-"o by Theorem 13.51 Then for this, we claim that /3 T t»o > P T W-. (To 
see this, assume in contrast that P T v$ = (3 T W-. Since V{ ^ O, there is a point y on the 
line segment joining vq and Vi and also in a small neighborhood of V{, satisfying y ^ O and 
y € n 5) \ To. It contradicts to (7~^_ D <S) \ (^o U O) = again.) Consequently, there 

is a point p €S such that /? T t>o > (3 T p. Let 

+ a + Bui = X(p - v ), (8.3) 

where A is a scalar to be determined. Following along the same lines as above, there exists 
a Ui attained from (|8.3p satisfying 

hj ■ (Avi + a + Bui) = Xhj ■ (p - v ) < for any j / 0. (8.4) 

Second, we consider the case that V{ G O. For this we discuss two situations depending on 
vq (namely, (3 T w + > (3 T v > (3 T W- and (3 T vo > (3 T w + ). 

(i) If T w + > fi T v > (3 T W-i then there is a p' € S \ {vq} such that (3 T vo = P T p'. Let 

Avi + a + Bui = X'{p - v ), (8.5) 

where A' > is an arbitrary constant. Note that (p' — vq) G B by this choice and that 
Avi + a G B (due to Vi € O), so there is a U{ satisfying the equation above. On the other 
hand, from the definition of simplices, it follows that hj ■ (p' — vq) < for any j ^ 0. Thus, 
there exists a U{ attained from (18. 5p satisfying 

hj ■ (Avi + a + Bui) = X'hj ■ {p - v Q ) < for any j ^ 0. (8.6) 

In addition, for this p', there has to be a facet J~k not containing p', where k € {1, . . . , n}. 
Thus, we have h^ ■ (p' — vq) < and therefore 

h k ■ (Avi + a + Bui) = X'h k ■ (p' - v ) < for every v { € O. (8.7) 

(ii) If (3 t vq > (3 T w + , then we claim that together any n — 1 vectors from h\ , . . . , h n 
are linearly independent. (To this end, assume it is not true. Without loss of generality, 
we suppose that and hi, ■ ■ ■ , h n -\ are linearly dependent. Then (3 can be written as 
/3 = Xihi H h A n _i/i n _i. Thus, 

P ■ (V n ~ Vo) = Xihi ■ (v n — Vq) H h A n _i/l n _i • (v n - V ). 

Note that hj ■ (v n — vq) = for any j = 1, . . . , n — 1, so (5 ■ (v n — vo) = and (3 T v n = (3 T vo, a 

contradiction.) Since S — > Tq and dS max = {vq} in this case, from Theorem 13.51 we have 
■uo ^ O. Let 5 < be a scalar. Since j3 and h%,. .. , hi-i, h^i, . . . , h n are linear independent, 
there is a unique solution to the following linear equation 

P ■ V = 0, hj - y = 5, j = 1, . . . , i - 1, i + 1, . . . , n 

Moreover, note that P ■ y = implies y € B and that Vi E O implies Av{ + a € £>. So there 
exists a Uj satisfying j4t>j + a + i?Mj = y, which further implies that 

hj ■ (Avi + a + -B«i) = /ij • y = 5 < for any j ^ i. (8-8) 
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Figure 11. Partition of the simplex S. 



Thus, it is proved that the invariance condition holds at every vertex, from (|8.2|) . (|8.4p . 

Note that once the control inputs uq, . . . ,u n at corresponding vertices Vq, . . . ,v n are found, 
an affine control u = Fx + g can be uniquely constructed by solving the equation 

[u ■■■ u n ) = [ F g ] 

Now we examine three cases to synthesize the feedback. 

First, consider the case when (3 T w + > [3 T v a > f3 T W-. Select the control inputs uq, . . . ,u n 
satisfying the invariance condition and construct the affine control u{x) = Fx+g from (|8.9p . 
With this choice of control, we have shown that (|8.7p also holds for every vertex Vi £ O. 

o 

Since Od 5=0, one obtains that O n S is the convex hull of these vertices in O. By 
convexity, it follows from (|8.7p that ■ {Ax + a + Bu{x)) < for any x in OdS. Recall that 
the possible equilibria of the closed-loop system lie in O. So it implies that no equilibrium of 
the closed-loop system is in S. Therefore, by Theorem 14. 11 the affine control u{x) = Fx + g 

solves Problem 14.11 and therefore achieves S — ► J-$ . 

Second, consider the case when (3 t vq > (3 T w + and <f_ O. Select the control inputs 
uq, . . . ,u n satisfying the invariance condition and construct the affine control u(x) = Fx + g 
from (18. 9h . We know vq ^ O and there is a vertex vt € J-q not in O. From (|8.8j) . we have 
hk ■ (Avi + a + Bu{vi)) < for every V{ € O since k ^ i. Following along the same lines as 
above, by Theorem 14.11 an affine control u(x) = Fx + g solves Problem 14.11 and therefore 

achieves S — * JT . 

Finally, consider the case when P t vq > f3 T w+ and J-q C O. By Theorem l3.5l ff is not parallel 
to O, which implies [3 T w+ > /3 T W-. So we can pick a point v' on the line segment joining 
u>_ and t>o satisfying (3 T w+ > (5 T v' > (3 T W-. The simplex S is then partitioned into two 
simplices, S\ and S2, along the hyperplane containing v' and the vertices in vert(^ r o)\{ u; -}- 
See Figure [TT] for an example. Note that in this case O is the hyperplane containing J r Q, 
so v 1 and vq are not in O. Let J-'q be the common facet of S\ and £2- For <Si, we know 
(3 t vq > max{P T Vi : V{ E J-q} and T'q is not in O. Hence, from the second case above, 
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there exists an affine feedback u = F\x + g\ that achieves S\ — ^» J-'q. For S2, we have 
(3 T w+ > f5 T v' > (3 T W-. So from the first case above, there exists an affine feedback 

u = F2X + g2 that achieves £2 — ► J-q. In total, the feedback 

U={ FlX + 91 if X e ^1 \ 5 2, 

\ F 2 x + g 2 if x G S2 

achieves S — > JT . 

8.8. Proof of Lemma 17. 2L For i = 1,2, let .A" and A^ be the possible failure sets to 
reach T{ defined in (13. ip and (|3.2p . respectively. 

We first claim that if Af 7^ then At = for j 7^ i. To see this, suppose that Aj 7^ 0. 
Then it follows from (|3.2p that At = V + . Also for same reason, Af 7^ implies Af = V + . 

It means V is a failure set to reach fiUJ^i a contradiction to "P — ► ^1 U ^2 • 

Second, we claim that if A~ 7^ then Aj = for j 7^ i. Suppose instead that both sets 
are not empty. Then from (|3,ip . there is a point p G argmin{/3 T x : x € T 3 } that belongs to 
both A~ and Aj. So this point cannot reach T\ U J-2, a contradiction, too. 

Third, we claim that A^ fl At = for i 7^ j. Note that A^ C P+, so if there is a 
p G argmin{/? T x : x G J^i} such that p V + , then it is clear from (|3.ip that A t ~ n Aj = 0. 
Instead if for all p G argmin{/3 T x : x G ^i}, p G P + , then we know Ti C P + . So V + is of 
(n — l)-dimension that is clearly parallel to B. Notice that O is not parallel to B from the 

o t , 

controllability assumption. Hence, V + On H + , which implies Aj = from ()3.2|) . So 
the conclusion follows. 

Now we come to prove that Reach^T 3 , Ti) UReac!^^ ^2) = V. Let A*_ and A\ + (i = 1, 2) 
be the over-approximations of A^~ and Af obtained by applying Algorithm [TJ Consider a 
point x G V \ Reach^T 5 , .Fi) if it exists. Then x is either in A*_ or in A\ + . Consider 
the first case when x G A\_. That means, A^ 7^ 0. Thus by our first claim, we get 
A2 = 0- Moreover, by our third claim that A]~ fl A\ = 0, we know for sufficiently small e, 
A,|_ fl A\ = 0. Thus x G" A^ + and it must be in Reach^T 7 , .T-b)- Consider now the second 
case when x G A\ ■ That means, A^ 7^ 0. Then by our second claim, we obtain that 
A2 = 0- Moreover, since Af fl A^ = 0, then by the same argument as above, we know the 
point x has to be in Reach^T 5 , T-i). 
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